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1.  BRIEF  SUMMARY  OF  RESEARCH  CONTRIBUTIONS 

We  have  made  fundamental  research  contributions  in  the  two  areas  (a)  and  (b)  mentioned 
in  the  original  research  proposal  for  ARO. 

(a)  Model  Based  Decision  Methods  for  Image  Segmentation  and  Other  Applications 

(al)  Visual  texture  is  an  important  aspect  of  images.  Traditionally,  all  edges  in  an  image 
were  considered  as  "intensity"  edges  since  they  were  defined  in  terms  of  the  change  in  the  inten¬ 
sity  across  the  edge  pixel.  However,  we  showed  that  even  when  there  is  no  sharp  change  in  the 
intensity  across  a  pixel,  still  an  edge  is  visible  caused  by  the  differing  textures  across  the  pixel 
and  these  edges  were  defined  as  texture  edges.  We  have  developed  systematic  methods  of 
detecting  both  texture  edges  and  intensity  edges  in  real  images.  A  two  stage  generate-and- 
confirm  paradigm  is  developed  for  detecting  the  edges.  The  texture  edges  are  detected  by  fitting 
a  parametric  random  field  model  -  the  so-called  nonsymmetric  half  plane  (NSHP)  model.  The 
results  are  published  in  the  journal  paper  [Eom,  Kashyap,  1990]. 

The  above  method  does  not  use  any  prior  knowledge  of  the  pattern.  We  can  improve  the 
sharpness  of  the  segmentation  boundaries  by  using  prior  knowledge  of  the  patterns  expressed  in 
terms  of  a  pitwedure  or  rules.  Li  [1990]  has  shown  that  there  is  a  considerable  improvement  in 
the  quality  segmentation  by  using  these  rules. 

(a2)  Shape  from  a  Textured  and  Shaded  Surface  Image 

To  recover  3-D  stmcture  from  a  textured  and  shaded  surface  image,  neither  the  shape- 
from-shading  nor  the  shape-from-texture  analysis  is  enough,  because  information  of  both  radi¬ 
ance  and  texture  coexist  within  the  scene  surface.  A  new  3-D  texture  model  is  developed  by 
considering  the  scene  image  as  the  superposition  of  a  smooth  shaded  image  and  a  random  tex¬ 
ture  image.  For  the  deterministic  part  of  the  model  the  modified  reflectance  map  function  with 
the  normalization  factor  is  applied  and  for  the  random  pan  the  onhographically  projected  long- 
correlation  periodic  model  is  developed  to  take  care  of  the  non-isotropic  distribution  function, 
because  the  long-correlation  periodic  model  has  the  ability  to  represent  the  coarseness  and  the 
pattern  of  the  surface  at  the  same  time.  These  two  pans  of  the  model  are  superposed  in  the  fre¬ 
quency  domain  and  the  estimation  and  the  synthesis  is  done  based  on  the  local  patch  analysis. 
For  estimating  the  surface  orientation  parameters,  a  hybrid  method  which  uses  both  the  least 
square  and  the  maximum  likelihood  estimates  is  applied  directly  to  the  given  intensity  function. 
By  using  these  parameters,  the  synthesized  image  is  obtained  and  used  to  reconstruct  the  origi¬ 
nal  image.  The  contribution  of  this  research  will  be  in  combining  shape-from-shading  and 
shape-from-texture  techniques  to  extract  3-D  structure  and  texture  pattern  features  directly  from 
a  single  image  which  contains  both  shade  and  texture  in  it  without  requiring  any  pre-processing. 
The  details  are  in  the  journal  paper  [Choe  and  Kashyap,  1991],  [Choe,  1990]. 
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(b)  Robust  Combination  of  Uncertain  Evidence  from  Several  Different  Sources  and  Their 
Application 

(bl)  We  consider  the  development  of  mathematical  procedures  for  combining  different 
pieces  of  evidence  and  their  propagation  in  a  lattice  structured  net.  The  application  of  Shafer’s 
belief  function  to  deal  with  uncertainty  in  expert  systems  has  attracted  much  attention  in 
artificial  intelligence  research.  Due  to  the  incomplete  and  inexact  nature  of  information,  uncer¬ 
tainties  in  an  inference  network  can  be  properly  represented  by  intervals  in  [0,1]  and  modeled 
by  Shafer’s  belief  functions.  Reasoning  with  uncertainty  in  an  inference  network  consists  of  the 
aggregation  of  uncertain  information  from  various  sources.  Three  types  of  belief  aggregation 
operation  can  be  identified:  belief  conjunction,  belief  combination,  and  belief  propagation. 
Previous  belief  function  approaches  have  focused  on  using  Dempster’s  rule  to  deal  with  the 
belief  combination  problem  without  mentioning  how  to  formally  deal  with  belief  propagation 
problem.  Furthermore,  as  we  shall  illustrate,  Dempster’s  rule  lacks  robustness  when  combining 
highly  conflicting  evidence. 

The  cause  of  the  nonrobustness  is  discussed  and  an  alternative  belief  combination  pro¬ 
cedure  is  proposed  to  remedy  the  deficiency.  Although  the  proposed  belief  propagation  pro¬ 
cedure  yields  results  that  are  dependent  upon  the  interpretations  of  the  rule,  the  belief  propaga¬ 
tion  procedure  is  shown  to  be  an  interpolation  between  total  ignorance  [0,1]  and  the  uncenainty 
associated  with  the  rule  regardless  of  the  interpretations.  When  the  mle  interpretation  yields 
associative  belief  propagation  procedure,  corresponding  chaining  syllogism  for  belief  propaga¬ 
tion  procedure  can  be  derived.  Finally,  the  proposed  inference  procedures  are  applied  to 
lattice-structured  inference  network.  The  work  discussed  in  this  paper  is  intended  to  provide  a 
unified  framework  to  belief  combination  and  belief  propagation.  The  results  are  contained  in 
the  journal  paper  [Hau  and  Kashyap,  1990]. 

(b2)  Axiomatic  Approach  to  Evidence  Combination 

The  thesis  by  Chang  presents  a  new  mathematical  procedure  for  combining  different 
pieces  of  evidence  which  are  represented  in  the  interval  form  to  reflect  our  knowledge  about  the 
truth  of  a  hypothesis.  Evidences  may  be  correlated  to  each  other  (dependent  evidences)  or 
conflicting  in  supports  (conflicting  evidences).  First,  assuming  independent  evidences,  we  pro¬ 
posed  a  methodology  to  construct  combination  rules  which  obey  a  set  of  essential  properties. 
The  method  is  based  on  a  geometric  model.  We  compare  results  obtained  from  Dempster’s, 
intervals  Bayes  and  the  proposed  combination  rules  with  both  conflicting  and  non-conflicting 
data  and  show  that  the  values  generated  by  proposed  combining  rules  are  in  tune  with  our  intui¬ 
tion  in  both  cases.  Secondly,  in  the  case  evidences  are  known  to  be  dependent,  we  analyze  the 
dependency  problem  in  terms  of  the  modified  Bayesian  approach.  We  also  consider  extensions 
of  the  rules  derived  earlier  to  handle  dependency  in  evidences.  The  performance  of  proposed 
rules  are  shown  by  several  different  examples.  The  results  show  that  the  proposed  rules  reason¬ 
ably  make  decision  under  dependent  evidences.  The  details  are  in  the  Ph.D.  thesis  by  Chang 
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and  the  paper  [Kashyap  and  Chang,  1990]. 

(b3)  Applications  of  the  Theory  of  Evidence  Combination 

Geometrical  reasoning  for  recognition  of  three  dimensional  object  features,  a  method  for 
extracting  shape  features  firom  the  boundary  representation  of  a  solid  polyhedral  object,  is 
presented.  In  this  approach  the  part  is  represented  as  a  global  graph,  from  which  the  labelled 
graphs  called  cavity  graphs  corresponding  to  the  depressions  in  the  boundary  of  the  object  are 
constracted.  Both  edges  and  vertices  of  cavity  graphs  are  labelled.  The  cavity  graphs  are  used 
to  generate  a  set  of  hypotheses  about  the  primitive  features  interacting  in  the  depression.  Rule- 
based  experts  using  a  cooperative  reasoning  scheme  select  the  correct  hypotheses. 

Emphasis  is  placed  on  recognizing  interacting  features  not  extracted  by  previous  methods. 
Toward  this  end,  we  have  developed  a  series  of  measures  to  correctly  extract  primitives  when 
intersecting  faces  of  a  primitive  become  separated,  or  some  faces  of  a  primitive  split  into 
disconnected  pieces  as  a  result  of  its  interaction  with  other  primitives.  Hence,  the  method 
tolerates  the  cases  in  which  the  cavity  graph  representation  of  the  primitive  in  interaction  is  dif¬ 
ferent  from  the  isolated  representation.  Experimental  results  for  a  number  of  example,  which 
are  not  correctly  analyzed  by  previously  proposed  systems,  are  presented  throughout  the  paper 
and  implementation  details  are  discussed.  The  details  are  in  the  journal  paper  [Marefat  and 
Kashyap,  1990]. 

We  have  used  the  evidence  combination  methodology  for  achieving  information  routing 
and  sensor  fusion  [Iyengar,  et  al.,  1992;  Jayasimha,  et  al.,  1991;  Prasad,  et  al.,  1991]. 

We  have  also  used  some  of  these  ideas  in  developing  a  procedure  for  matching  polygons. 
We  have  developed  a  distance  measure  between  two  polygons  to  measure  their  closeness  in 
shape.  This  is  invariant  to  rotation  of  the  polygon.  Details  are  in  the  journal  paper  [Koch  and 
Kashyap,  1989]. 

A  list  of  publications  supported  by  the  contract  is  given  in  section  2. 
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[7]  Y.  Choe  and  R.L.  Kashyap  (1991),  "3D  Shape  from  a  Shaded  and  a  Textural  Surface 
Image,"  IEEE  Trans,  on  Pattern  Analysis  and  Machine  Intelligence,  Vol.  13,  No.  9,  pp. 
907-919. 

[8]  S.S.  Iyengar,  M.B.  Sharma,  and  R.L.  Kashyap  (1992),  "Information  Routing  and  Reliabil¬ 
ity  Issues  in  Distributed  Sensor  Networks,"  IEEE  Trans.  Signal  Processing,  (accepted  for 
publication). 

19]  Jayasimha,  S.S.  Iyengar,  and  R.L.  Kashyap  (1991),  "Information  Integration  and  Syn¬ 
chronization  in  Distributed  Sensor  Networks,"  IEEE  Trans,  on  Systems,  Man,  and  Cyber¬ 
netics,  Vol.  21,  No.  5,  Sept. -Oct.  1991. 

[10]  L.  Prasad,  S.S.  Iyengar,  R.L.  Kashyap,  and  R.N.  Madan  (1991),  "Functional  Characteriza¬ 
tion  of  Sensor  Integration  in  Distributed  Sensor  Networks,"  IEEE  Trans,  on  Systems, 
Man,  and  Cybernetics,  Vol.  21,  No.  5,  Sept.-Oct.  1991. 
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